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Overview: Computability Theory 


Computability Theory 


o imperative models of computation: 

D1. Turing-Computability 

D2. LOOP- and WHILE-Computability 

D3. GOTO-Computability 
o functional models of computation: 

D4. Primitive Recursion and u-Recursion 

D5. Primitive/u-Recursion vs. LOOP-/WHILE-Computability 
o undecidable problems: 

D6. Decidability and Semi-Decidability 

D7. Halting Problem and Reductions 

D8. Rice's Theorem and Other Undecidable Problems 
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Literature for this Chapter (English) 


Introduction to the Theory of Computation 
by Michael Sipser (3rd edition) 


o 
Notes: 
o Sipser does not cover all topics we do. 


o His definitions differ from ours. 
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Undecidable Problems 


o We now know many characterizations 
of semi-decidability and decidability. 


o What's missing is a concrete example 
for an undecidable (= not decidable) problem. 


o Do undecidable problems even exist? 
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Undecidable Problems 


o We now know many characterizations 
of semi-decidability and decidability. 

o What's missing is a concrete example 
for an undecidable (= not decidable) problem. 

o Do undecidable problems even exist? 

e Yes! Counting argument: there are (for a fixed 2) 
as many decision algorithms (e. g., Turing machines) as 
numbers in No but as many languages as numbers in R. 
Since No cannot be surjectively mapped to R, 
languages with no decision algorithm exist. 


o But this argument does not give us a concrete undecidable 
problem. ^» main goal of this chapter 
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Turing Machines as Words 


TMs as Words 
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Turing Machines as Inputs 


o The first undecidable problems that we will get to know 
have Turing machines as their input. 


^» "programs that have programs as input”: 
cf. compilers, interpreters, virtual machines, etc. 
e We have to think about how we can encode 
arbitrary Turing machines as words over a fixed alphabet. 
e We use the binary alphabet © = {0,1}. 
e As an intermediate step we first encode over the alphabet 
xr = {0,1,#}. 
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Encoding a Turing Machine as a Word (1) 


Step 1: encode a Turing machine as a word over {0,1,#} 
Reminder: Turing machine M = (Q,2,T,, ô, qo, O, E) 
Idea: 

o input alphabet X should always be {0,1} 


e enumerate states in Q and symbols in F 
and consider them as numbers 0,1,2,... 


o blank symbol always receives number 2 


o start state always receives number 0 
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Encoding a Turing Machine as a Word (1) 


Step 1: encode a Turing machine as a word over {0,1,#} 
Reminder: Turing machine M = (Q,%,T,6, qo, O, E) 
Idea: 

e input alphabet X should always be {0,1} 


e enumerate states in Q and symbols in F 
and consider them as numbers 0,1,2,... 


o blank symbol always receives number 2 


o start state always receives number 0 


Then it is sufficient to only encode ô explicitly: 
o O: all states mentioned in the encoding of ô 
o E: all states that never occur on a left-hand side of a ö-rule 


e [ = {0, 1,0, a3, a4, ..., ax}, where k is the largest symbol 
number mentioned in the ó-rules 
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Encoding a Turing Machine as a Word (2) 


encode the rules: 
o Let ó(q;i, aj) = (qi, ay, y) be a rule in ô, 
where the indices i, i’, j, j' correspond to the enumeration of 
states/symbols and y € {L, R, N}. 
e encode this rule as 


Wi j,i’ jy = ##bin(i)#bin(j)#bin(i’)#bin(j')#bin(m), where 


0 fy=L 
m=<41 ify=R 
2 ity=N 


o For every rule in 6, we obtain one such word. 


o All of these words in seguence (in arbitrary order) 
encode the Turing machine. 
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Encoding a Turing Machine as a Word (3) 


Step 2: transform into word over {0,1} with mapping 


0— 00 
1H 01 
dc 11 


Turing machine can be reconstructed from its encoding. 
How? 
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Word (4) 


Example (step 1) 
5(q2, a3) = (qo, a2, N) becomes ##10#11#0#10#10 
5(q1, a1) = (qa, ao, L) becomes ##1#1#11#0#0 


Example (step 2) 
##1O#11#0#10#10##1#1411#0#0 
111101001101011100110100110100111101110111010111001100 
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Example (step 1) 
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Example (step 1) 
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Example (step 1) 
5(q2, a3) = (qo, a2, N) becomes ##10#11#0#10#10 
5(q1, a1) = (qa, ao, L) becomes ##1#1#11#0#0 


Example (step 2) 
##10#11#0#10#10##1#1411#0#0 
111101001101011100110100110100111101110111010111001100 


: We can also consider the encoded word 
(uniquely; why?) as a number that enumerates this TM. 


This is not important for the halting problem but in other contexts 
where we operate on numbers instead of words. 
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Turing Machine Encoded by a Word 


goal: function that maps any word in {0,1}* to a Turing machine 


problem: not all words in {0,1}* are encodings of a Turing machine 


solution: Let M be an arbitrary fixed deterministic Turing machine 
(for example one that always immediately stops). Then: 


Definition (Turing Machine Encoded by a Word) 
For all w € 10,177 


ME M’ if w is the encoding of some DTM M’ 
" | M otherwise 
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Questions 


Questions? 


Special Halting Problem 
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Special Halting Problem 
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Special Halting Problem 


Our preparations are now done and we can define: 


Definition (Special Halting Problem) 


The special halting problem or self-application problem 
is the language 


K = {we {0,1}* | My started on w terminates}. 


German: spezielles Halteproblem, Selbstanwendbarkeitsproblem 


Note: word w plays two roles as encoding of the TM 
and as input for encoded machine 
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Semi-Decidability of the Special Halting Problem 


Theorem (Semi-Decidability of the Special Halting Problem) 


The special halting problem is semi-decidable. 


We construct an “interpreter” for DTMs 
that receives the encoding of a DTM as input w 
and simulates its computation on input w. 


If the simulated DTM stops, the interpreter returns 1. 
Otherwise it does not return. 


ne ; 
This interpreter computes Xg. 


Note: TMs simulating arbitrary TMs are called TMs. 


German: universelle Turingmaschine 
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Undecidability of the Special Halting Problem (1) 


Theorem (Undecidability of the Special Halting Problem) 
The special halting problem is undecidable. 
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Undecidability of the Special Halting Problem (1) 


Theorem (Undecidability of the Special Halting Problem) 
The special halting problem is undecidable. 


Proof by contradiction: we assume that the special halting problem 
K were decidable and derive a contradiction. 
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Undecidability of the Special Halting Problem (1) 


Theorem (Undecidability of the Special Halting Problem) 
The special halting problem is undecidable. 


Proof by contradiction: we assume that the special halting problem 
K were decidable and derive a contradiction. 


So assume K is decidable. Then xx is computable (why?). 
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Undecidability of the Special Halting Problem (1) 


Theorem (Undecidability of the Special Halting Problem) 
The special halting problem is undecidable. 


Proof by contradiction: we assume that the special halting problem 
K were decidable and derive a contradiction. 

So assume K is decidable. Then xx is computable (why?). 

Let M be a Turing machine that computes xx, i.e., 


given a word w writes 1 or O onto the tape 
(depending on whether w € K) and then stops. 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 

Construct a new machine M as follows: 
@ Execute M on the input w. 
O If the tape content is 0: stop. 
@ Otherwise: enter an endless loop. 


Special Halting Problem 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 

Construct a new machine M’ as follows: 
@ Execute M on the input w. 
O If the tape content is 0: stop. 
@ Otherwise: enter an endless loop. 


Let w’ be the encoding of M'. How will M' behave on input w/? 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 
Construct a new machine M as follows: 
@ Execute M on the input w. 
O If the tape content is 0: stop. 
@ Otherwise: enter an endless loop. 
Let w’ be the encoding of M'. How will M' behave on input w/? 


M' run on w’ stops 
iff M run on w’ outputs O 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 
Construct a new machine M as follows: 
@ Execute M on the input w. 
O If the tape content is 0: stop. 
@ Otherwise: enter an endless loop. 
Let w’ be the encoding of M’. How will M’ behave on input w’? 


M' run on w/ stops 
iff M run on w’ outputs 0 
iff xx(w’) = 0 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 


Construct a new machine M! as follows: 


@ Execute M on the input w. 
O If the tape content is 0: stop. 
@ Otherwise: enter an endless loop. 


Let w’ be the encoding of M’. How will M’ behave on input w’? 


M' run on w’ stops 

iff M run on w’ outputs 0 
iff xx(w’) = 0 

iff w € K 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 


Construct a new machine M! as follows: 


@ Execute M on the input w. 
O If the tape content is 0: stop. 
O Otherwise: enter an endless loop. 


Let w’ be the encoding of M’. How will M’ behave on input w’? 


M' run on w/ stops 

iff M run on w’ outputs 0 

iff xx(w’) = 0 

iff w d K 

iff My run on w’ does not stop 
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Undecidability of the Special Halting Problem (2) 


Proof (continued). 


Construct a new machine M! as follows: 


@ Execute M on the input w. 
O If the tape content is 0: stop. 
O Otherwise: enter an endless loop. 


Let w’ be the encoding of M’. How will M’ behave on input w’? 


M' run on w’ stops 

iff M run on w’ outputs 0 

iff xx(w’) = 0 

iff w d K 

iff Mw run on w’ does not stop 
iff M' run on w/ does not stop 


Contradiction! This proves the theorem. 
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Questions 


Questions? 


Reprise: Type-0 Languages 


ler Type-0 Languages 
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Back to Chapter C7: Closure Properties 


Intersection Union Complement Product Star 


Type 3 Yes Yes Yes Yes Yes | 
Type 2 No Yes No Yes Yes 
Type 1 Yes(1) Yes Yes(1) Yes Yes | 
Type 0 Yes!) Yes No?) Yes Yes 
Proofs? 


(1) without proof 
(2) proofs in later chapters (part D) 


Type-0 Languages 
00800 


Back to Chapter C7: Decidability 


Word Emptiness Equivalence Intersection 
problem problem problem problem 
Type 3 | Yes Yes Yes Yes 
| Type 2 Yes Yes No No 
DE 1 Yes No() No No 
Type0  No® No) Nol) Nol) 


(1) without proof 
(2) proof in later chapters (part D) 
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Answers to Old Questions 


Closure properties: 
e K is semi-decidable (and thus type 0) but not decidable. 
~> K is not semi-decidable, thus not type 0. 
^» Type-0 languages are not closed under complement. 


Decidability: 
o K is type 0 but not decidable. 
^» word problem for type-0 languages not decidable 


^» emptiness, equivalence, intersection problem: later in exercises 
(We are still missing some important results for this.) 
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Questions 


Questions? 


Reductions 
@0000000 


Reductions 
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What We Achieved So Far: Discussion 


o We now know a concrete undecidable problem. 
o But the problem is rather artificial: 
how often do we want to apply a program to itself? 
o We will see that we can derive further (more useful) 
undecidability results from the undecidability 
of the special halting problem. 
o The central notion for this is reducing 
a new problem to an already known problem. 
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Reductions: Definition 


Definition (Reduction) 


Let A C ** and B CI™ be languages, and let f : 2* > T* 
be a total and computable function such that for all x € X*: 


x €A if and only if f(x) c B. 


Then we say that A can be reduced to B (in symbols: A < B), 
and f is called reduction from A to B. 


German: A ist auf B reduzierbar, Reduktion von A auf B 
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Reduction Property 


Theorem (Reductions vs. Semi-Decidability/Decidability) 
Let A and B be languages with A < B. Then: 
O /f B is decidable, then A is decidable. 

Q If B is semi-decidable, then A is semi-decidable. 

© ff A is not decidable, then B is not decidable. 

O ff A is not semi-decidable, then B is not semi-decidable. 


^ In the following, we use 3. to show undecidability 
for further problems. 
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Reduction Property: Proof 


for 1.: The following algorithm computes xA(x) given input x: 
ze) 

result := xg(y) 

RETURN result 
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Reduction Property: Proof 


for 1.: The following algorithm computes xA(x) given input x: 
le) 

result := xg(y) 

RETURN result 


for 2.: identical to (1), but use x (instead of xg) 
to compute x^, (instead of xa) 


Reductions 
O00068000 


Reduction Property: Proof 


for 1.: The following algorithm computes xA(x) given input x: 


y = e) 
result := xg(y) 
RETURN result 


for 2.: identical to (1), but use x (instead of xg) 
to compute x^, (instead of xa) 


for 3./4.: contrapositions of 1./2. ~> logically equivalent 
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Reductions are Preorders 


Theorem (Reductions are Preorders) 


The relation “<” is a preorder: 


@ For all languages A: 
A < A (reflexivity) 
Q For all languages A, B, C: 
If A € B and B < C, then A < C (transitivity) 


German: schwache Halbordnung/Quasiordnung, Reflexivität, 
Transitivitat 
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Reductions are Preorders: Proof 


for 1.: The function f(x) = x is a reduction from A to A 
because it is total and computable and x € A iff f(x) € A. 


for 2.: ^^ exercises 
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Summary 


Summary 


The special halting problem (self-application problem) 

is undecidable. 

However, it is semi-decidable. 

important concept in this chapter: 

Turing machines represented as words 

^ Turing machines taking Turing machines as their input 
reductions: “embedding” a problem as a special case 

of another problem 

important method for proving undecidability: 

reduce from a known undecidable problem to a new problem 


Summary 
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